arXiv:1501.03756v2 [q-fin.TR] 16 Jan 2015 


Optimal Trading with Alpha Predictors 


Filippo Passerini* and Samuel E. Vazquez^ 

^Department of Physics, Princeton University, Princeton, NJ 08544 
Laboratoire de Physique Theorique, Ecole Normale Superieure, 75005 Paris, France 
Wega Edge LLC, 48 Wall Street 11th Floor, New York, NY 10005 


January 19, 2015 


Abstract 

We study the problem of optimal trading using general alpha predictors with linear costs and 
temporary impact. We do this within the framework of stochastic optimization with finite horizon 
using both limit and market orders. Consistently with other studies, we find that the presence of 
linear costs induces a “no-trading” zone when using market orders, and a corresponding “market¬ 
making” zone when using limit orders. We show that, when combining both market and limit orders, 
the problem is further divided into zones in which we trade more aggressively using market orders. 
Even though we do not solve analytically the full optimization problem, we present explicit and simple 
analytical “recipes” which approximate the full solution and are easy to implement in practice. We 
test the algorithms using Monte Carlo simulations and show how they improve our Profit and Losses. 


1 Introduction 

In this paper we take the point of view of a general trader who wants to profit from all possible sources 
of alpha, including predictors and even possibly market-making with limit orders. Hence, we present 
a very general and practical framework inspired by the Hamilton-Jacobi-Bellman (HJB) method. We 
do not seek to find exact analytical solutions to the optimization problems, but to introduce some 
algorithmic “recipes” which can be easily implemented in real trading. We allow the use of both limit 
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and market orders and general alpha predictors. We show that many popular optimization problems 
in the literature can be viewed as special cases of our framework. 

The study of optimal trading under linear costs has a long history. We will not review all the 
literature here but instead point the reader to the following review: [T]. Previous works have mostly 
focused on the case of optimal investment, where the agent has the choice of a risky asset and a savings 
account, or in the case of optimal consumption (see e.g. mm)- Moreover, the most popular set up is 
the stochastic control optimization with infinite time horizon. These works have all confirmed that the 
optimal strategy involves trading instantaneously to the boundary of a no-trading (NT) zone centered 
at the Markowitz Portfolio. As the name suggests, inside this zone, the agent does not trade. The 
width of the zone has been estimated by many authors using different approximation methods (see 
e.g. [llElle]). However, no closed-form solutions are known. In fact, the full optimization problem is 
quite intractable. The majority of the literature on linear costs does not consider the predictability of 
the risky asset (apart from a drift). The notable exceptions are: [7l|8l[9]. In these papers the explicit 
width of the NT zone is estimated in the limit of small linear costs and mean-reverting predictors. 

Another source of slippage is price impact, see e.g. [TO]. This effect is only important when we 
trade a non-trivial fraction of the daily volume. It is well known that impact can be divided into a 
permanent and temporary part. Empirically, it is found that temporary impact leads to an aggregated 
cost which is a power of the total transacted quantity Q: C{Q) ~ For mathematical simplicity, 

many papers on optimization simplify this power-law behavior with a simpler quadratic cost model: 
CiQ) Q^. In fact, the problem of trading mean-reverting alpha predictors with quadratic costs can 
be solved in closed form m- The optimal liquidation problem under temporary impact has recently 
been studied in [T2|. The optimal investment problem has been studied under the presence of both 
linear and quadratic costs in m- 

Another rather separated stream of literature has studied the use of limit orders both for the 
liquidation m ESI and market-making m-m- The problem of optimally placing market versus 
limit orders under the possibility of partial execution was studied in [iilEaEal. For market-making, 
the main problem is the optimal price of the limit orders and the inventory risk. If we ignore partial 
execution, one can obtain explicit solutions for the HJB equations HKISI. One piece missing from 
most of these articles is the addition of general alpha predictors, as the focus has been mainly market¬ 
making or liquidation. In pQj some basic predictability was introduced in the price process. Another 
problem with limit orders is that the optimization problems can be even more intractable that in the 
case of linear costs (market orders). 

In this paper we seek to bring together ingredients from all these works to formulate an optimization 
problem for a general alpha trader. We do this with a finite time horizon. This choice of boundary 
condition is motivated by the reality of trading. With the exception of FX markets, most assets are 
traded over finite market hours and marked-to-market to the close of the trading day. In fact, the 
standard accounting practice is to divide the total daily P&L into the part coming from the trades 
(trade-to-close) and the part coming from the open positions (close-to-close). As traders, we can only 
control the trading during the present day and possibly the overnight risk we want to keep for the next 
day. This is specially important for high-frequency traders and market makers as they must limit the 
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amount of overnight risk. Another important fact about trading is that often we use signals that are 
calculated with daily data which is officially available only after the market closing time. This might 
be for operational reasons or due to the nature of the data. In this case, intuition tells us that it makes 
sense to trade as soon as possible the next day as to maximize the use of the daily signal’s alpha (or 
to minimize the time delay). Our optimization results indeed lead to such behavior. Intuition also 
tells us that high frequency signals should be useful to trade towards a daily or slowly moving target. 
In fact, we will write our optimization as a tracking problem which seeks to minimize the residual risk 
between our portfolio and the daily Markowitz portfolio. 

One difference with most works is that we do not seek to find exact or numerical solutions to the 
HJB equations (except in some simple cases). Instead, using general properties of the solution we 
show how to construct simple approximations that can easily be used in practice. While we allow the 
presence of temporary market impact, we will be more interested in the case of linear costs. Hence, the 
focus will be on finding simple expressions for the boundaries of the NT or market-making zone. For 
the case of limit orders, we do not take into account partial execution. We find that in the presence 
of alpha predictors, one can be in a zone where it is optimal to send a market order. Furthermore, 
once we get closer to the NT zone (in this case a market-making zone), the use of a directional limit 
order is more desirable. In this paper we do not study in details the optimization over the limit order 
placement (i.e. its price). However, we point out how this can easily be included in our formalism. In 
order to test our algorithms, we use simple Monte Carlo simulations driven by mean-reverting alpha 
sources. We find that our strategies improve the global Sharpe of our P&L compared to the case of 
simply trading using market orders to the daily Markowitz portfolio. 

In the remaining of this section we present our notation, introducing few definitions that will be 
used in the following. In section 2 we describe the optimization problem with market orders only. We 
introduce the objective function and derive the relevant HJB equation. We propose an approximate 
solution of the HJB equation, and discuss the validity of the approximation. The trading strategy 
obtained from the approximate HJB solution is tested using a Monte Carlo simulation. In section 3 
we revisit the optimization problem, considering both limit and market orders. Also for this case, we 
derive an approximate solution of the relevant HJB equation and test the associated trading strategy 
using a Monte Carlo simulation. Appendix A contains basic facts about the Ornstein-Uhlenbeck 
process, which is used to model the predictors. Appendix B describes the HJB equation for the case 
of a general transient impact function. Appendix C, D and E, consider different regimes where the 
optimization problem simplifies. In particular, in appendix C we show that in the case of a zero 
volatility signal, the optimization problem can be solved exactly using the Euler-Lagrange variational 
principle. In appendix D the HJB equation is solved exactly for the case of quadratic impact and 
zero linear costs. In appendix E we focus on the case of large price impact and define a perturbative 
scheme to solve the HJB equation recursively. 
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1.1 Notation 


We are allowed to trade from today’s market opening time topen until today’s market closing time T. 
The time interval between the close of subsequent market days is equal to T, therefore yesterday’s 
closing time is 0 and tomorrow’s closing time is 2T. We will optimize the integrated P&L from some 
time t included in today’s trading hours, that is t G [topen,T], until tomorrow’s closing time, that is 
2T. The relevant times are represented on the time’s arrow in hgure 


Previous Today's Today's Tomorrow's 

Close Open Close Close 



Figure 1: Trading time arrow. We denote today’s opening time as topen and today’s closing time as T. The 
previous day’s close is at time 0 and the next day’s close is at time 2T. 

For simplicity, we will consider a single asset with price Pt- The dynamics of the price is given by 

dPt = atdt + y/udWt ( 1 ) 

where dt is the time scale of our trading decisions and Wt is a standard Wiener process. The stochastic 
dependence in time will be denoted with a subscript, as in dPt- Without loss of generality, we will 
decompose the drift at into a constant a and intraday component xt with zero mean: 

at\= a + xt , E[xt] = 0 ( 2 ) 

where as usual, E[...] denotes unconditional expectation and the conditional expectation is denoted 
as E[... I condition]. We can think of a as the alpha that comes from the daily predictors, while xt 
comes from the intraday or HF signals. At this point we leave the dynamics of xt to be quite general: 

dxt = fi{t, xt)dt + y/r]{t,xt)dZt (3) 

where the drift fj,{t,xt) and variance r]{t,xt) are allowed to depend on time t and the signal xt- We 
usually model the fast signal as a Ornstein-Uhlenbeck process, that is a mean-reverting process with 
constant volatility: dxt = —nxtdt -|- ^yijdZt. Basics results concerning the Ornstein-Uhlenbeck mean- 
reverting process are collected in appendix [A) 
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For later convenience, we introduce the following differential operator: 

d d I 


( 4 ) 


which is the infinitesimal generator of time translation and Ito diffusion for the process described in 
©■ We define the integrated gain of the HF signal as: 


r2T 


g{t,x):= / K[xs\xt = x]ds 


(5) 


which encodes the gain associated to the intraday signal from time t during today’s trading hours 
to the end of tomorrow’s trade. Using Feynman-Kac formula, one can show that the integrated gain 
obeys the following relation: 


Dt,x ■ g{t, x) + X = 0 

The evolution of our position qt is given by: 

dqt = utdt 


( 6 ) 

(7) 


where ut is the rate of trading at time t. The optimization problem boils down to finding the optimal 
rate of trading ut that minimizes a certain objective function. In general, we expect out trading rate 
to be a local function of time, our current position, and our predictor: ut := u{t, xt, qt)- 
In the following, we will make use of the positive part function (x)+, defined as 

(x)+:=x0(x) (8) 

with 9{x) is the Heaviside step function with 0(0) = 0. 


2 Optimization with market orders 


In this section we study the case of trading using market orders. For simplicity of notation, we 
assume that the half-spread is constant. However, relaxing this restriction is quite simple and our 
final (approximate) results are valid regardless of the dynamics of the spread. We focus on trading 
during a single day. Therefore, we are allowed to trade from some time t during open market hours, 
to the close of the present day, that is time T. However, in order to take into account the overnight 
risk and possible alpha, we will optimize the integrated P&L from some time t during the present day 
to the close of the next trading day, that is 2T. 

Under our assumptions, the relevant objective function is given by 


Q,{t,x,q) = 


min E 

{ushe(t,T)} 

r2T 


I asqsds + -Xu 


j C\us\ds + K J u^ds 
1 



- 

/ Qsds 

qt = q,xt = X 

Jt 

_ 


(9) 
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where the optimal trading strategy is the one that gives the minimum possible value for 
The first term on the RHS of © is the cost of the market orders, where C is half of the bid-ask 
spread, which is assumed to be constant. The second term serves as a control or regulator for the size 
of the trades. In particular, a large value for the constant K implies small average trade size, and 
vice versa. However, it can also be interpreted as coming from temporary market impact. In fact, 
we can also model a general impact function K / for a general exponent p. For simplicity, in 

the main text we will focus on the quadratic impact function. The case with a general exponent p is 
discussed in appendix Both the first and the second term in encode contributions associated 
to the trading, therefore are integrated between the initial time to the close of the present day, given 
that we are optimizing the trading during a single day. 

The third term is the gain coming from the alpha of the asset. This includes the contribution of the 
daily alpha a, which is constant during the trading day under consideration, and the HF component 
xt- The last term in Q is a risk control, and it is proportional to the variance of the P&L. The 
constant A is a risk aversion parameter. We notice that both the third and fourth term are integrated 
up to the close of the next trading day, in order to model the overnight risk and alpha. 

Using the Hamilton-Jacobi-Bellman (HJB) principle, we can write the following relation for the 
objective function it{t,x,q) defined in Q: 


n(t, X, q) 


min E 


{C\u\ + Ku^ — {a + x)q + -Xnq‘^)dt 


+Q{t + dt,x + dx, q + dq) 


qt = q,xt = X 


( 10 ) 


Applying Ito’s lemma, from relation (10) we can derive the following HJB equation for the objective 
function: 


A.a: • X, q) - (a + x)q + -Xvq'^ -|- min 

2 u 


C\u\ + Ku^ + 

oq 


= 0 


( 11 ) 


where the differential operator Dt^x is defined in (|4j). In order to get a better intuition about the 
optimization problem, it is convenient to work with a slightly different version of the objective function 
(§. Indeed, as we will show, we can write the optimization as a portfolio tracking problem. For that, 
we introduce the daily Markowitz portfolio: 


a 



and a new objective function: 


( 12 ) 


V(t, X, q) := n{t, X, q) -h g{t, x)q + ]^Xvq^{2T - t) (13) 

where g{t,x) is the gain associated to the HF signal, as defined in equation ([^. The two functions 
V{t, X, q) and Xl{t, x, q) differ by terms that do not depend on the trading rate Ug, which implies that 
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they are modeling the same optimization problem. That is, we can use indistinctly one of the two 
objective functions to compute the optimal trading rate. In the following we will always work with 
V{t,x,q). 

To understand the meaning of the objective function V it is useful to write it as 


V{t,x,q) 


min E 
{ush6(i,'r)} 



g{s,Xs)us) ds 


I-T ^ y2T 

+K J ulds + -\i' J {qs-q)‘^ds 


qt = q,xt = x 


(14) 


The first term is the effective cost of the market order, once we take into account the HF predictor. It 
follows that the intraday signal can be used to reduce the cost of trading, which in principle can also 
become negative. The last term is the integrated residual risk (variance) of the difference between 
our position and the daily Markowitz portfolio. This is the term that pushes the trading toward the 
daily Markowitz portfolio q, which is the target position suggested by the daily signal. It follows that 
the original optimization problem is dual to tracking the Markowitz portfolio using the fast signals. 
This decomposition, while rather arbitrary, is very useful in practice as the trader can simply replace 
q with the ideal portfolio which comes from a daily back-test. 

Using the definition (13), and the HJB equation for 0 (11), it is possible to write down an HJB 
equation for V: 


Dt,x ■ V + - qf + min 

Z u 


C\u\ + Ku^ + ( ^ - g] u 


= 0 


(15) 


where we used the relation (§. The boundary condition follows from the expression ( |14[ ) and it is 
given by: 


V{T,x,q) = -X,^T{q-qf 


(16) 


which is precisely the residual variance around the Markowitz portfolio, at the end of the day. The 


optimization problem boils down to solving the HJB equation (15) with boundary condition (16). 


the term 


In order to reduce the equation (15) to a standard PDF, we derive the trading rate u that minimizes 
C\u\ + Kv? + — g^ u . In this way, the trading rate u is related to the gain g, the 

linear costs C, and the derivative of the objective function respect to the initial position, that is 
The explicit expression for u depends on the location in the (t, x, q) space. In particular, the {t, x, q) 
space is divided into three regions and in each of these regions u assumes a different expressioiij^ These 
are the regions where we buy, sell or don’t trade. In details, the three zones and the corresponding 
trading rate u are given by: 


^Another possible formulation of the problem is to assume constant and discretized trading rate, that is u G [—Q,0, Q]. 
We will consider this model in the next section, where we allow also limit orders. 
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1. g > C + ^. In this case m > 0, so we buy. 


dV 


2. g < —C + In this case n < 0, so we sell: 


2K 


dV\ 


U = -7777 - C'+ 77- 


dq J 


3. —C + ^<g<C + ^. In this case we don’t trade, that is: 


dV 


u = 0 


(17) 


(18) 


(19) 


The boundary between the sell zone and the no-trading (NT) zone is a two dimensional manifold 
embedded in the {t,x,q) space. We describe it via an explicit parameterization q = b-{t,x). In the 
same way, the boundary between the buy zone and the NT zone is described as q = b^{t,x). From 
equations it follows that b±{t,x) are implicitly defined by the following equations: 


g^c 


dV 



( 20 ) 


An optimal trading trajectory that starts from the buy zone, enters the NT zone and stays there until 
the end of the day is sketched in figure As we show in appendix this scenario is realized for the 
case of a mean reverting signal with zero volatility. For the case of a stochastic signal, in general one 
can go in and out of the NT region many times during the day. As we can see in figure the width 
of the NT zone increases towards the end of the day. This means that we are more aggressive at the 
beginning of the day. Note that this is consistent with our intuition under the presence of a daily 
signal. Since the daily signal is simply a drift, we maximize our profit by trading at the beginning of 
the day. 

We can summarize the trading rate u as: 


2K 


dV 


dq 


^=WT7{9-C-—] - — l-g-c+ — 


2K 


dV 


dq 


( 21 ) 


where the positive part function (x)+ is defined in 
in compact form: 

1 


The equation for V (15) can now be written 


Dt,x ■ V + ^Aiy(q - qf - Ku^ = 0 


( 22 ) 


where u is given in (21) and the boundary condition is defined in (16). The HJB equation (22) is very 
difficult to solve in general. In the remaining of this section we consider the approximation where 







Sell Zone 


b_(t,x) 


No-Trading Zone 



> t 


T 


Figure 2: The sell, buy and no-trading (NT) zones are shown in this hgure. We denote as b-{t,x) {b^{t,x)) the 
boundary between the sell (buy) region and the NT region. We show a trading trajectory with initial position in 
the buy zone. The trading moves the position toward the NT zone, and when this is reached, the trading stops. 


the source term —Kv? in equation (22) is neglected. We argue that this is a good approximation for 
a market without price impact, that is in the limit itT —)• 0, and describe the implementation of our 
trading strategy for this scenario using a Monte Carlo simulation. 

In the case where the signal has zero volatility, there is no uncertainty and the optimization problem 
can be solved using the Euler-Lagrange variational principle. We discuss this case in appendix 0 
where we are able to derive an explicit expression for the boundaries b± for any deterministic signal. 
We also compute the optimal trading trajectory for the case of a deterministic mean revering signal, 
showing that for this case, once we enter the no-trading (NT) zone, we stay there until the end of the 
day. Another general feature of the solution is that as X —)• 0 we go instantaneously to one of the 
boundaries of the NT zone (if we are out). 

Another exactly solvable case is when we set the linear costs to zero, that is C = 0. In this 
case, we are left with the quadratic costs and the problem becomes very similar to the discrete-time 
optimization studied in m- In appendix [0 we solve this problem explicitly for a general signal using 
the Feynman-Kac theorem. 

We notice that the problem discussed in [Hj essentially corresponds to the optimization problem 
described in this section, but in the case of an inhnite time horizon and in the regime where the 
boundary of the NT region is reached instantaneously (no price impact). 
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2.1 Approximate HJB solution 

We have shown how the optimal strategy can be expressed in terms of the objective function, which 


is defined by the HJB equation (22). An exact analytical solution of this equation seems out of reach, 


therefore for practical purposes, we propose using the solution that comes from ignoring the source 
term —Ku^ in (22), that is: 


V^^Xu{2T-t){q-qf 

Using this approximate objective function V, we obtain 

dV 

— = \v{2T - t){q - q) 


and equation (20) can be solved explicitly to obtain the boundaries b±{t,x). It results: 

1 


b±{t,x) = q + 


\v{2T — t) 


{g{t,x) C) 


(23) 


(24) 


(25) 


We notice that (25) is equivalent to the correspondent expression for the deterministic case (63), where 


the deterministic gain is replaced by the stochastic gain. 


In which regime can we justify the approximation (23)? In the limit K - 
l/W, therefore also the source term goes to zero as —Kv? 


oo, the trading rate goes 
^ 1/K. It follows that in 


to zero as u ~ 

this regime, as a first order approximation we can neglect the source term and work with the solution 
in (23). In fact, one can also define a systematic expansion in 1/A, as we describe in appendix [E} 
The other, more practical limit is when A —)• 0, that corresponds to the scenario where the price 
impact is negligible and is a good approximation for the case of a small trader. In this case, as 
suggested by intuition and the results for the deterministic case in appendix we trade towards the 
boundary of the NT zone instantaneously (when we are out of the NT region). One can argue that in 
this case u diverges, but in practice, the trade size must be finite, that is 


dq = udt = finite 


(26) 


Moreover, in practice dt is finite (e.g. one second), therefore u remains finite as A goes to zero and 
we can justify our approximation —Kv? ~ 0. This is, of course, not a formal mathematical proof but 


only an argument that will allow us to use the result (25) for the case when the market impact can 
be neglected. 


2.2 Implementation and simulation 

We now describe how our formalism can be implemented for real trading. We consider the case of a 
small trader, where the price impact can be ignored. As we have already discussed, this corresponds 
to the limit A —)• 0, where the approximation (23) is reliable. In this regime, we trade instantaneously 
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towards one of the boundaries if we are out of the NT zone. In particular, we trade to the b-{t,x) 
boundary if we are in the sell zone and to the boundary x) if we are in the buy zone. The 


expression for the boundaries b±{t,x) is given in (25). The basic trading decision scale is set to dt. 

We can take the daily Markowitz positions q to be the ideal positions that come from a daily back 
test. Therefore, the Lagrange multiplier A can be written as: 


A 


Annualized Sharpe Ratio of Daily Target 
Annualized Volatility of Daily Target 


(27) 


We assume that we can model high-frequency predictors as mean-reverting processes. In practice, 
it is useful to decompose our intraday alpha xt in terms of a z-score or signal et with IE[et] = 0 and 
Var[et] = 1. We can write: 


xt := 

det = —Ketdt + V^dZt (28) 

The constant fd can be conveniently written in terms of the annual Sharpe ratio of the ideal HF 
position qt = et/y/u: 


/3 


Annualized Sharpe Ratio of HF Signal 
\/252r 


The gain is then: 


ff(Le) = 


fdy/ve 


1 — e 


-K(2T-t) 




(29) 


(30) 


where the last approximation is valid if the time scale of the predictor is much smaller than one day. 

We have tested our algorithm with a Monte Carlo simulation, the results are shown in figure In 
the simulation, the decision time scale is dt = I minute and when we are out of the NT zone we trade 
directly to the boundary of the NT zone in one shot. The intraday signal has a mean-reversion of 30 
mins, and the daily signal is constant during the day, but varies from day to day with a mean-reversion 
time scale of 10 days and a annual Sharpe of 2.1. Other relevant parameters are the price variance 
V = 0.01, the half spread C = 0.01, the risk aversion A = 37.4. We parameterize the HF as in (28) 
with /? = 1, which corresponds to a HF Sharpe = 16.5. 

In figure the blue line is the cumulative P&L for the daily signal, where the trading is all at the 
beginning of the day, and the linear costs are ignored. The green line is the same P&L with the linear 
costs taken into account. The red line is the P&L for our strategy obtained from the HJB approach, 
which takes into account also the trading costs. We see that, thanks to the HF signal and the intraday 
trading, our strategy outperforms the daily strategy. Indeed, our P&L is higher than the daily P&L, 
also when the trading costs are ignored, which means that thanks to the HF signal we can follow the 
daily signal with negative trading costs. 
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Cumulative P&L 



Figure 3: This figure shows several cumulative P&L’s, where the numbers in parenthesis in the legend are the 
correspondent Sharpe ratios. The blue line is the P&L of a daily strategy without taking into account the linear 
costs. The green line is the same strategy with the linear costs taken into account. The red line is the HJB 
strategy with intraday trading, that also takes into account the trading costs. The HP mean-reversion scale is 30 
mins and the daily signal mean-reversion time scale is 10 days. The relevant parameters are: v = 0.01, C = 0.01, 
A = 37.4, P = l. 

3 Optimization with limit orders 

We now revisit the optimization problem described in the previous sections, allowing also limit or¬ 
ders. We can use the same HJB framework, where now the trading rate ut defined in Q can get a 
contribution from market orders and limit orders. In details, our position will now evolve according 
to: 


dqt = {mt -m^ + 1 +if - \ f )dt , mf ,lf > 0 (31) 

where mf and if are the sizes of the market and limit orders respectively. The indicator \f equals 
one if the limit order is executed in the interval dt and zero otherwise. Hence, we assume that our 
limit orders are small enough to be filled in one shot (we ignore partial fills). 

For simplicity, we will assume that the spread is constant (one tick) and hence limit orders are 
only executed if there is a mid price move in the right direction. As in the previous section, we denote 
as C the half spread. At the end of the interval dt all pending limit orders are canceled. We also 
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assume that we place limit orders at the top of the book and hence do not optimize for their price. 
We will comment on how to implement a price optimization at the end of the section. 

Let , P~ be the conditional probability that a limit buy and sell order will be filled within the 
next time step dt. So far we have modeled the price in our decision interval dt as a diffusion process. 
However, in real life, there are price movements inside dt which are discrete (tick-by-tick). These are 
the movements which must be predicted by P^. Hence for limit orders, we must have a very short 
term predictor yt which might be different from the longer-term intraday alpha xt- Hence, the fill 
probabilities can be a function of time and our different intraday alpha streams: 


P^{t,x,y) := E[lt\xt = x,yt = y] 


(32) 


In practice, we expect yt to dominate the fill probability by having a much shorter mean-reversion 
time scale than xt- Moreover, ideally we would have both alpha sources being uncorrelated. We will 
come back to this point in section 

We will ignore price impact and simply cap the size of our trades so that: 


m 


rri^ G 
G 


[0,Q] 
[0,Q] 

G [0,Q] 


(33) 

(34) 

(35) 


where Q > 0. Note that, as will become apparent below, without the impact term the last restriction 
will simply pick either the limit or market order. 


The HJB equation (15) takes the following form: 


0 = 


Dt,x,yV +^Xu{q-qf 


+ min 

m±,Z± 


m' -P+1+ (^C-^+g 




(36) 


where, as in the previous section, C is half of the bid-ask spread and it is assumed to be constant, 
and Dt^x,y is the infinitesimal generator of time and ltd diffusion for our set of predictors. 


Our trading decisions are based on the optimization over in the HJB equation (36). As in 


the case of market orders, we find different trading regions. In particular, we find a sell region, a buy 
region and a market-making region. Both the sell and the buy regions are divided into two subregions, 
that is the market orders region, where we send market orders, and the limit orders region, where 
we send limit orders. In total, our strategy includes five regions: a region where we send sell market 
orders, a region where we send sell limit orders, a region where we do market-making, a region where 
we send buy limit orders and a region where we send buy market orders. 

In details, the five regions we just described, are defined by the following expressions: 
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1. g > send a buy market order. 

^ ^ ^ 9 ^ C l^pt + ^ send a buy limit order. 

3. —C + ^<fl'<C + ^we send both a buy and a sell limit order (market-making). 

4- —C + ^ < 5 < “C* + ^ we send a sell limit order. 

5. g < —C ^ we send a sell market order. 

We note that the boundaries of the market-making region are the same as the NT zone in the case of 
market orders only. Therefore, using the same notation as in the previous section, they are defined by 


g=FC = 


dV 

dq 


(37) 


q=b± 


where 6+(t,x) {b-{t,x)) now separates the market-making region from the buy (sell) limit region. 
We define b+{t,x, P~^) as the boundary between the buy market region and the buy limit region 
and b-{t,x, P~) as the boundary between the sell market region and the sell limit region. They are 
implicitly defined by the following equation 


gpC 


1 -h 
1 


dV 

dq 


(38) 


q=b± 


The five trading regions and all the boundaries are sketched in figure This is a schematic represen¬ 
tation, where x,P~^,P~ are constant during the day. In reality, they are stochastic quantities. 

Note that the strategy requires market orders when we are far from the market-making region 
(that is we are far from the ideal daily position q), and requires limit orders when we are close to 
it. Therefore, the strategy becomes more aggressive when we are far from the optimal position, in 
agreement with intuition. 


In section 3.2, we test our strategy using a Monte Carlo simulation. In our simplified model we 


find that it is suboptimal to send both buy and sell limit orders at the same time (market-making). 
The reason is that, in our simple simulation, we never get both orders executed at the same time, and 
we are forced to trade more in the future. Instead, it is optimal to not trade in this region. Therefore, 
in our simulations we will replace the market making region with a no-trading region. 

What is the optimal values for the trading rate Q? As in the case of market orders, in the absence 
of impact, we would like to trade as much as possible. However, we should not cross trading regions 
because this will lead to more unnecessary back-and-forth trading in the future. Hence, we argue that 
it is optimal to trade to the boundary of our current trading region. 

Note that we have not optimized for the price of the limit orders as in [a El]. Even though we 
will not study this problem in detail in this paper, we should mention that this optimization is simple 
to implement in our framework. For example, assuming that the spread is always one tick, let C + 5^ 
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Figure 4: The five zones for the case with limit orders are shown in this figure. We denote as b-{t,x) (6+(t,x)) 
the boundary between the sell (buy) limit region and the market-making region. The boundaries between the 
sell (buy) market region and the sell (buy) limit region are denoted as P~^) (6+(t, x, P“)). For graphical 

purposes, we represent the zones for the case of constant x,P^,P~. 


be the price distance of the limit orders from the mid price, where 5^ > 0. The fill probability for a 
limit order with a price distance C + 6^, is defined as 

P^{6^,t,x,y) := E[l^± Jxi = x,yt = y] (39) 

Then our optimization problem now includes two more dimensions: 


mm 

m±,Z±,(5± 


m 




dv 


dq 


+m (C-— — \-g]-P {6 ,t,x,y)l [C + 5 +—- g 


dV 


dq 


(40) 


The detailed study and simulation of the problem including optimal order placement will be left for 
future work. 
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3.1 Approximate HJB solution 

As in the case of market orders, a full solution of the HJB equation seems hopeless. Therefore in this 
case, we also approximate V to be the value function of the no-trading zone: 


which gives 


V{t,x,q) 


^Xu{2T - t){q - qf 


dV 

dq 


\v{2T - t){q - q) 


(41) 


(42) 


Equations (37) and (38) can be solved explicitly to obtain the boundaries b±{t,x) and b±{t,x, P^). 
It results: 


b±{t,x) 


b±{t,x,P^) 


q + 
q + 


1 

\i'{2T — t) 

1 

\i'{2T — t) 


{g{t,x) =F C) 


(43) 


3.2 Implementation and simulation 


We have tested our trading strategy using a Monte Carlo simulation. In particular, we work in 
the approximation described in section 3.1 where he boundaries of the various regions are given in 


equations (43). As we already mentioned, we are in the approximation of zero impact factor, therefore 
we trade instantaneously to the boundary of the region in which we are. 

For our simulations, in order to capture the very short-term behavior of the price relevant to limit 
orders, we decompose our intraday alpha as a slow (et) and fast (it) predictors. That is: 


dPt = (a -|- xt)dt + y/i'dWt 
xt = Viy {jiet + 
det = —K€tdt + V^dZt 

dit = —Retdt + V^dZt (44) 

The fast signal will dominate the short term price predictability only if: 


/ 3 >/ 3 , 



K 


K 


In fact, the mean reversion scale of it will be of the order of dt: 


(45) 


~ 1/dt 


(46) 
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In this case, the fill probabilities will be functions of e only, while the long-term integrated gain will 
be only a function of ef. 




P^(e) = $ 




(47) 


where is the cumulative function of the unit normal distribution. In the figure we show the result 
of a Monte Carlo simulation with our simple limit/market order algorithm. All parameters are the 
same as in our simulation in sectionFor the fast signal it, we take a mean-reversion time scale of 1 
minute (that is, it is equal to dt) and /3 = 13. As in the previous simulation, we trade instantaneously 
towards the boundary of our zone. Even though our simulation does not take into account the market 
making, we find a mild improvement from the use of limit orders. 


Cumulative P&L 



Figure 5: The first three cumulative P&L in the legend are the same trading strategy described in figure The 
last P&L in the legend (the light blue line), is associated to the HJB strategy with intraday trading, with market 
and limit orders. Trading costs are also taken into account. The relevant parameters are as in figure and the 
fast predictor has mean-reversion time scale of 1 minute and /3 = 13. 
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4 Conclusions 


In this paper we have developed a general framework to derive optimal trading strategies which exploit 
any possible source of alpha. We used the Hamilton-Jacobi-Bellman (HJB) theory, and even though 
the HJB equations cannot be solved exactly (except in few simplifying limits), we have presented 
several algorithms which are inspired on general features of the exact solution and can be easily 
implemented in real trading. 

Our framework uses finite horizon optimization. Indeed, we optimize the trade during one single 
day and we take into account the overnight risk and possible overnight alpha. We isolate the daily 
component of the predictors from the intraday one. In this way, the daily alpha that is constant during 
any single trading day, defines an ideal position or Markowitz portfolio, which the trader should reach. 
Our strategy specifies how the intraday signals can be exploited to reach the ideal position dictated 
by the daily signal. 

We take into account two sources of slippage: temporary market impact and linear costs. The 
former implies a reduction of the trading rate. The latter, in the case where we allow only market 
orders, gives rise to a no-trading (NT) region centered around the Markowitz portfolio and with 
boundaries that depend on the value of the intraday predictors. A trader with a position outside of 
the NT region trades toward the boundary of the NT region. See figure 

In the case where we allow both market and limit orders, the NT region is replaced by a market¬ 
making region, where the trader sends a buy and a sell limit order together. In this set up, the buy 
and the sell regions are divided each one into two subregions, characterized by the type of orders that 
are used. For instance, the sell region is divided into a sell limit region, where the trader sends sell 
limit orders, and a sell market region where the trader sends sell market orders. The market order 
regions are the most distant from the Markowitz portfolio, therefore in agreement with intuition, in 
these regions we trade more aggressively sending market orders. See figure]^ 

To summarize, our framework combines limit and market orders in a unifying way and allows the 
trader to exploit daily alpha signals, intraday alpha signals and market-making around the optimal 
daily position. 

We have tested our analytical algorithms using Monte Carlo simulations, focusing on the case of 
a small trader where the price impact can be neglected. The numerics confirm that our strategies 
increase the cumulative Profit and Losses respect to a trader which naively follows the Markowitz 
portfolio. 

In this paper we have not optimized for the price of the limit orders, but simply considered the 
orders which are the closest to the mid price (that is, limit orders at the top of the order book). 
Furthermore, our simple Monte Carlo did not allow for a numerical simulation of the market-making, 
and we replaced this region with a no-trading region. It is natural to expect that a proper optimization 
of the limit orders price and the inclusion of market-making will further improve the Profit and Losses 
in our simulations. We leave this for future studies. 
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A Ornstein-Uhlenbeck mean reverting process 

The Ornstein-Uhlenbeck process is described by: 

dxt = k{x — xt)dt + y/rjdZt 


(48) 


which implies that the process reverts around the value x with a reversion rate equal to k. In the 
main text we usually consider x = 0, however the results in this appendix are derived for a general x 
for completeness. The variance rj is taken to be constant and Zt is a standard Wiener process. The 
solution of the (48), with boundary condition xt = x, is given by 

Xs = X + {x — e~'^^^~'^^dZr (49) 

Xs is normally distributed and its expectation and variance, conditioned by the boundary condition 
Xt = X, are given by 


E[xs\xt = x] = X + {x — x)e 
Var [xs\xt = x] = 


(50) 


Considering the process Xs as an HE signal, we can compute its gain g{t,x) as defined in formula ([^. 
It results 


g{t,x) = X {2T — t) + -—^^(1 —e *^) 

K 

and it can be checked explicitly that the general condition ([^ is satisfied. It follows 

dg{t, x) = —X dt + '^{1 — dZt 


(51) 


(52) 


Also the gain g{s, Xg) is normally distributed, with conditional mean M{s) and conditional variance 


S^(s) given by 


M{s) := K [g{s,Xs)\xt = x] = X {2T — s) + 


X — X 


(1-e 




T.\s) := Var b(s,x,)|xt = x] = ^(l-e-2"(^-‘))(l-e-"(2r-^))2 


(53) 
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B HJB equation with general price impact function 


In this appendix we write down the HJB equation for the case with a general temporary impact 
function K f \us\^ ds with p > 1. The objective function (14) is generalized to the following function 


V(t,x,q) = min E 
{«ds6(iT)} 


(C|tts| - g{s,Xs)us) ds 


+K 


1 

\us\^ds +-\i^ J {qs-q)‘^ds 


qt = q,xt = x 


which satisfies the HJB equation 


Dt,x ■ V + \xu{q - qf + min 
2 u 


C\u\ + K\u\^ ^ ^ ^ 


= 0 


(54) 


As in the quadratic case discussed in the main text, due to the minimization respect to u, the 
solution is divided into three trading regions: 


1. g > C + ^. In this case u > 0, so we buy: 


1 \ 


pK 


^ 9-C-^ 


dV\ p-i 


dq 


(55) 


2. g < —C + ^. In this case u < 0, so we sell: 


1 \ 


pK 


^ = - ^ -9-C+^ 


dV\ p-i 


dq 


(56) 


%<9<C + % 

The trade rate u is concisely written as: 


3. —C + ^<g<C + ^. In this case we don’t trade (u = 0). 


u = 


^(±V-' IT 


\pK 


dq 


pK 


P-1 


-g-C+ — 
dq 


dV\ p-i 


(57) 


and the HJB equation (54) can be written as: 


1 


• H + -Xu{q - qY - Kip - l)|u|P = 0 


(58) 
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C Zero volatility signal 

We consider the approximation where the HF signal xt has zero volatility, that is 

dx{t) = fi{t,x{t))dt (59) 


In this case, the optimization problem is completely deterministic and the optimal strategy, defined 
as the strategy that minimizes the objective function (14), can be computed using the variational 
principle. When the initial position is located in the buy or the sell zone, it is optimal to trade toward 
the no-trading (NT) zone. We assume that we reach the NT zone before the market closes, and once 
we have entered the NT zone, we stay there until the end of the day. As we will show, this is a correct 
assumption for the case of an exponential signal (or zero signal). In general, however, the boundaries 
of the NT region depend on x and hence one can go in and out of the region many times, also for a 
deterministic signal. 

Under our assumptions, if the initial position q{t) = q is located in the sell region, we sell until 
we reach 6_, the threshold between the sell and the NT region. That is, we sell until a time t such 
that q{t) = b-{t,x{t)). Analogously, in the case where the initial position is located in the buy zone, 
we buy until we reach 6_|_, the threshold between the buy zone and the NT region. That is, until a 
stopping time t such that q{t) = b+{t,x{t)). We denote as V- (V+) the objective function (14) for the 
case where we start from the sell (buy) region. Explicitly, 


V±{t,x,q) 


mm 

{g(s)|sG(t,T)} 


±Cq{s) - g{s)q{s) + Kq{s) +-Xi^iq{s,x{s)) - q) ] ds 


+ \xu{2T - i){{q{i) 


min 

{g(s)|sG(t,T)} 


v±[g(s)] 



(60) 


where in the last line we defined ^^^[^(s)], a functional of the trading trajectory q{s), which satisfies 
the boundary condition q{t) = q and q{s) := dq{s)/ds. Our signal x{s) is deterministic with boundary 
condition x{t) = x, and the gain is defined as g{s,x{s)) = x{r)dr, which is the deterministic limit 
of the gain defined in ([^. The optimal strategy is given by the trajectory q{s) that minimizes V±[g(s)], 
and can be derived using the Euler-Lagrange variational principle. That is, we require V±[g(s)] to 
be stationary with respect any admissible fluctuation around the minimizing trajectory. The initial 
position is fixed, therefore we do not allow fluctuations at initial time, that is dq{t) = 0. However, in 
general 6q{t) ^ 0, which will produce also equations of motion for boundary terms evaluated at time 
t. We have 


<5g(5)V±[g(s)] = {\v{2T - i) {q{i) -q) ±C - g{i, x{i))) Sq{i) 

+ [ ds {-2Kq{s) + g{s,x{s)) + \v{q{s) - q))5q{s) (61) 
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where we used q{t) = 0. Indeed, formula (21) shows that the trading rate goes to zero when we 
approach the NT zone. It follows that the trajectory that minimizes the cost function is described by 
two equations: 


0 = Xv{2T - i) {q{i) -q) ±C - g{i, x(i)) 

0 = -2Kq{s) + g{s,x{s)) + Xu{q{s) - q) (62) 

We remind that t is the time when the position reaches the boundary of the trading region, therefore 
q{i) is equivalent to b-{t,x{t)) {b+{i,x{t)) ) if we started from the sell (buy) region. It follows that 
the first equation can be written in the following way 

b±{i,x{i)) = ^ =f C) (63) 

which is an explicit expression for the boundaries of the trading regions 0 In order to integrate the 
second equation and solve the optimization problem, we consider an explicit dynamics for the signal 
x{t). 


C.l Deterministic mean reverting HF signal 

We start considering a deterministic mean reverting signal of the form 

dx{t) = —Kx{t)dt 

which can be integrated to 

x(s) = 

for s > t, and the associated gain is given by 

g{s,x{s)) = ^(e-^(^-*) 


The second equation can be integrated imposing the initial condition q{t) = q. It results 

^-A(s-t) _ ^-K(s-t) 


q{s) =x 


2Kk‘^ - Xu 


+ a e*^(l - e-2(*-*)^) + ^ (1 - + q 


(64) 

(65) 

( 66 ) 

(67) 


where ^ = y 5^ and a is an integration constant to be determined. The stopping time i and the 
integration constant a are fixed by the following system: 

q{i) = 0 
q{i) = b±{i,x{i)) 


( 68 ) 


^In this formula t is the stoppin g ti me. However, changing the value of K, t can span the whole trading interval [topen, T], 
therefore we can replace t —>■ i in (63), and interpret the (63) as the expression for the boundaries of the trading regions in 
the (t, q, x) space. 
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where in the second equation we take 6_ if we start from the sell zone and 6+ if we start from the 
buy zone. This system can be solved numerically. In figure we plot the solution (67) when the 
initial position is in the sell zone, showing that the result is in perfect agreement with a numerical 
optimization obtained with quadratic programing. We consider various values for the constant K, 
and as expected, as ii' —)> 0 we go instantaneously to one of the boundaries of the NT zone (if we are 
out). As X —)• oo we trade slowly towards the boundary. 
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Figure 6: In this hgure we plot the optimal trading trajectory for the case where the initial position is in the sell 
zone. The continuos lines show the result (67) for several values of the constant K. The stopping time t and the 
integration constant a are also reported in the legend. The dots show the results of a numerical optimization using 
quadratic programing. The dashed lines show the boundaries b±. The relevant parameters are chosen as follows: 
ly = 0.01, A = 50, C = 0.1, q = 1.0 and the mean reversion scale of the HF signal is 20 mins. 


C.2 General price impact function 


The variational principle can be applied also in the presence of a general price impact function. In 
particular, the equations (62) generalize to 


0 = Xiy{2T - i) {q{i) -q) ±C - g{i, x{t)) 

0 = TpK-^{±q{s)f~^ + g{s,x{s)) + Xiy{q{s) - q) (69) 
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We notice that the first equation is equivalent to the first equation in (62). This implies that, for a 
deterministic signal, the boundaries of the trading regions are the same for any impact function. 


D Market orders with quadratic costs 

In the case when we only consider quadratic costs (that is, (7 = 0) and market orders, 
trading rate is no longer discontinuous: 

1 ( dV 

The HJB equation then simplifies to: 

O.,. • r + \m>, - if - (s - ^) =0 

with the usual boundary conditions 

V{T,x,q) = ^Xi^T{q - q)‘^ 

One can solve ( |7l[ ) by making the following quadratic ansatz0 

V{t,x,q) = Vo{t,x) + Vi{t,x){q - q) + V 2 {t,x){q - qf 

which leads to the following PDEs 

Dt^x • ^2 + -Az/ — '^^2 — 0 

Dt,x-Vi + l,V2{g-Vi) = 0 

A 

bt,x-Vo-^{g-Vif = 0 

with the boundary conditions: 

V2{T,x) = 

Vi{T,x) = 0 
Vo{T,x) = 0 

^Solutions of HJB equations with a polynomial structure are described in e.g. 


the optimal 

(70) 

(71) 

(72) 

(73) 

(74) 

(75) 

(76) 

(77) 

(78) 

(79) 
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Using Feynman-Kac Theorem, it is easy to write down the general solution: 


V2{t) 

Vi{t,x) 

Vo{t,x) 


= KA 


tanh((r — t)A) + TA 
1 + r^tanh((T — t)A) 


. J t 


—E 
K 

——E 
iK 


e K ft U(s )ds ■j/2(s)5f(s, Xs)ds 


xt = x 


ig{s,Xs) - Ui(s,x^))^ ds 


Xt = X 


( 80 ) 

(81) 

(82) 


where ^ ^ • 


E K ^ oo limit 

In the large K limit, we consider the following ansatz for the objective function V: 

V = V„ + ^V, + ^V2 + ... 


(83) 


that is we write V as an expansion in 1/K. Plugging the ansatz (83) in the HJB equation (22) 
and collecting terms of the same order in 1/K, we can write down an equation for any term in the 


expansion (83), and solve the equation (22) iteratively. We describe this prescription in details for the 


first two terms Vq and Vi. 

The leading order term Vq satisfies the following equation 


Dt,x ■ Vq + - Q')^ = 0 


with boundary condition 


(84) 


Vo{T, X, q) = -\yT{q - qf 


(85) 


The solution to equation (84) with boundary condition (85) is given by 


Vo = ^Xu{2T-t){q-qf 


( 86 ) 


which is the approximate solution given in (23). 


The next to leading order term Vi satisfies the following equation 


1 


dVo 


--ys-C+ 


1 


= 


= 0 


(87) 
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with boundary condition 


Vi{T,q,x) = 0 


( 88 ) 


The solution to eqnation (|87|) with boundary (|88|) can be obtained using the Feynman-Kac formula 

2 


Vi{t,q,x) = -^E 




+ ( ~9{s, Xg) — C + 


dVojs) 

dq 


Xt = X 

(89) 


where the process xt is the general stochastic process in 

E.l Boundaries 


The boundaries b± are defined by the equations (20). In the current perturbative scheme, they are 
expanded as 


= 4”’+ + 


Using the expansions for V (83) and the expansion for b± (90), the equation (20) is written as 


dVo 

oq 


+ 1 ^ 
g=6(°) Kydq 




k(0) 

<i=^± 


of 


+ ... 


(90) 


(91) 


which can be solved order by order in the expansion. The leading order term b^^ is given in 


equation (25). The next to leading order term b^^ is given by 




dVi 


dq 

j,{0) 

q=b± 

aWn 


dq^ 

1,(0) 

q=bY 


(92) 


In the case where g{s,Xs) is normally distributed with conditional mean M(s) := E [g(s, Xs)\xt = x\ 

(s) := Var [g{s,Xs)\xt = x], it is possible to evaluate the expectations in 
We obtain 


and conditional variance 

dVi{t,q,x) 


(89) and compute ^^ 

r 


dVi{t,q,x) 

dq 


1 f‘ dOVois) 

2 ./, 


-a 2 (s) 


-aI(s) 

e 2 




e 2 


- A+(s)(l - ^(A+(s))) - A_(s)$(A_(s)) 


(93) 


^When Xt is an Ornstein-Uhlenbeck mean reverting process, g{s,Xs) is normally distributed and the expressions for mean 
and variance are given in (53). 
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where 


±C+^^-M{s) 

and <h is the cumulative function of the unit normal distribution function. The conventions are chosen 
so that the terms depending on A_ encode the contribution of the sell region and the terms with A+, 
are the contribution of the buy zone. 
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